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The recent surge in the network modeling of complex systems has set the stage for a new era in 
the study of fundamental and applied aspects of optimization in collective behavior. This Focus 
Issue presents an extended view of the state of the art in this field and includes articles from a large 
variety of domains where optimization manifests itself, including physical, biological, social, and 
technological networked systems. 
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One of the broadest areas of research, optimiza- 
tion has a very long history. It comprises the 
variational principles in physics and engineering, 
the survival-of-the-fittest principles that pervade 
biology and economics, the founding hypothe- 
ses of numerous computer algorithms, and the 
frameworks for addressing the improvement of ef- 
ficiency in various contexts. Whether a fact or a 
goal, a natural process or a man-made system, the 
apparently ubiquitous striving for optimization 
generates continuing appeal among researchers. 
But what is new about optimization in networked 
systems? 

Real-world systems do not operate isolated from each 
other. While a neuron can be studied in a laboratory 
setting, it has not evolved to work independently of the 
activity of other neurons nor has the brain evolved to 
work independently from the organism. In a hierarchy 
of scales, many systems are formed by the interconnec- 
tion of subsystems that may have different (or even op- 
posing) optimization goals than the global system which 
they are part of. Expectedly, the structure of these in- 
terconnections will influence the global performance and 
hence complex network research 0,0 is a key ingredient 
for studying optimal system behavior (see Fig. [I}. Not 
surprisingly, various structural and dynamical network 
properties have been explicitly related to the optimiza- 
tion of specific functions (see, e.g ., Refs. 0,110] forearl y 
works and Refs. @, 0, 0, 0, EI for recent reviews). In 
this context, there are entire classes of problems, ranging 
from epidemic spreading [ll[ to the control of cascading 
failures [e| , which are naturally defined as extremization 
problems. Others, such as the unexpected robustness ob- 
served in some systems, involve no a priory optimization 



conditions and yet reveal enhanced properties shaped by 
the evolution of the system. 

Optimal behavior is most often connected to a function 
that the system performs. In numerous cases the function 
is multi-variate or multi-faceted. For example, the power 
grid has as its main role the transport of electric energy 
while minimizing generation and distribution costs and 
maximizing at the same time reliability and quality of 
service. 'How network structure influences the global per- 
formance of such systems' is probably the question that 
is posed most frequently in network research. Conversely, 
the notion of network acts as a unifying theme in systems 
optimization. Indeed, with the increasing abundance of 
empirical and theoretical results, numerous optimization 
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FIG. 1: Illustration of levels of abstraction represented as 
networks that underlie a complex system, in this case an 
urban area. What network is relevant to an optimiza- 
tion problem depends on the specific research question at 
hand. The inlay images are courtesy of the TRANSIMS and 
EpiSims teams at LANL and Virginia Bioinformatics Insti- 
tute ( http : //ndssl . vbi . vt . edu| ) [ll|,[2§]. 
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questions involving apparently unrelated systems can be 
addressed using a common formalism of complex net- 
works of interacting units. 

Traditionally, optimization has a strict mathematical 
definition, which refers to obtaining the solutions that 
strictly extremize a well-defined functional. Here we 
adopt a looser definition of the word by extending it to 
include a tendency of the system to improve its behavior 
as a result of a selection pressure naturally or artificially 
imposed. Many real-world problems are complex, with 
a very large parameter space. Accordingly, most quests 
for finding "the" optimizing or "the" best solution is 
doomed to failure or not to be realistic. Finding a "good 
enough solution" or a "better solution" , perhaps even 
in an iterative manner, becomes, however, a workable 
alternative. Processes in nature follow this path. Nature 
has evolved biological systems under pressure towards 
increasingly optimal behavior and much can be learned 
by studying the behavior of these systems. Despite 
the complexity of the problems, the original work on 
scale-free networks already suggested that there could 
be some general principles in network optimization 0: 
many realistic networks, including the Internet and 
collaboration networks, tend to grow and evolve much 
in the same way as some biological systems do. If 
selection is important in biology, then it is expected to 
be important in other evolving systems too. 

Broad View of Network Optimization 

There are fundamentally four major types of opti- 
mization problems related to networked systems (the 
constraints arc considered to be implicit in the func- 
tional): 

Type I - Structural Optimization. Find a graph 
G(V, E) where V is the set of nodes and E is the set of 
edges which extremize a given structural functional F[G]. 

Type II - Dynamics Optimization on Static Graphs. For 
a given graph G{V 1 E) and a dynamical system <fr on G, 

*(x,x,...,{a},i) = 0, (1) 

find the values of the parameters {a} which extremize a 
global functional F[<&] of the dynamics <&. The variables 
x are quantities associated with properties of the nodes 
and edges in the network. 

Type III - Structural Optimization for Dynamics. Given 
the dynamical system (flj and a set of parameters {a}, 
find a graph G(V, E) for which a global functional F[<&] 
of the dynamics 3? is extremized. 

Type IV - Dynamics-driven Network Optimization. 
If the graph of the network evolves in time (i.e., 
G{V, E) = G(V, E,t)), either through an independent 
dynamics or through coupling to the dynamics in |[T]). 
find the values of the parameters {a} for which a global 



functional F[G, 3>] of the dynamics <fr and of the graph 
G(V, E, t) is extremized. 

Type I is a purely graph theoretic problem in that one 
looks for structures that have some specified properties. 
For example, given a fixed degree sequence on N nodes, 
construct a graph that minimizes the diameter. Prob- 
lems involving optimal assignment of edge-weights and - 
directionality also belong to this class. Type II is a "flow 
extremization" problem. For example, given a roadway 
network, what should be the speed limit for cars on every 
street such that jamming is minimized? Type III com- 
monly occurs in design problems: given a flow dynamics, 
such as packet flow in packet switched networks, find 
the graph structures optimal for information through- 
put. Other important examples include the optimization 
of synchronous and coherent behavior. Type IV is also 
common, though sometimes very difficult to solve be- 
cause properties of both graph structure and dynamics 
are allowed to change. This is also the most relevant case 
to the study of emergent properties in evolving systems. 
Robustness and vulnerability problems fall into this class 
when the flow through the network can change the struc- 
ture, which in turn changes the flow. Prime examples 
of this are cascading failures in networked systems, such 
as power grids (see the article by Dobson et al. in this 
issue). 

Optimization in complex networks is thus of broad sig- 
nificance, incorporating static and dynamical properties 
and serving as an instrument to analyze and control the 
evolution and function of both natural and engineered 
systems. 

This Focus Issue 

This Focus Issue brings together contributions on net- 
work structure and dynamics, with emphasis on opti- 
mization problems and their applications to infrastruc- 
ture and biological systems. Key topics discussed include 
the optimization in the evolution and functioning of bio- 
logical systems, optimization and cost balance analysis in 
the design of infrastructure networks, and optimization 
principles emerging from the interplay between network 
structure and dynamics. 

In the context of technological and infrastructure net- 
works, Danila et al. fl3| consider routing optimization in 
network transport, Dobson et al. fl4| discuss how compe- 
tition between efficiency and robustness leads to a SOC- 
based model for the power-grid dynamics, Guclu et al. 
[lH study how fluctuations and synchrony in distributed 
proces sing networks relate to the network structure, Gul- 
bahce |16| addresses the optimization of jamming on gra- 
dient networks, while Teuscher [T3| analyzes the impact 
of performance metrics in network-on-chip designs. 

In the context of biological networks, Almaas [l8| stud- 
ies metabolic flux patterns derived from flux-balance op- 
timization assumptions, Balcan and Erzan [l9j discuss a 
statistical physics description of content-based networks 
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which can serve as models for gene regulatory networks, 
Mahmoudi et al. [2(j consider the propagation of ex- 
ternal regulatory information and asynchronous dynam- 
ics in random Boolean networks, and Riecke et al. (2l| 
study a rich variety of dynamical states in the activity of 
small- world networks of excitable neurons. 

Other dynamical processes are also considered. Barrat 
et al. [22| address the emergence of consensus in linguistic 
conventions, Bogacz et al. [23j consider condensation and 
far from equilibrium dynamics on networks, and Freire 
et al. (24| analyze synchronization and complex spatio- 
temporal patterns in networks of cellular automata. 

More related to the structural properties of the net- 
works, Bianconi (2f| studies how the degree distribution 
follows from the extremization of a free-energy function, 
Kim and Kahng (26j derive spectral densities for an im- 
portant class of weighted complex networks, Kim et al. 
J27[ analyze the fractal properties of complex networks, 
and Minnhagen and Bernhardsson [28[ study how the de- 
gree distribution relates to maximization of information. 

Summing up, optimization of performance and ro- 
bustness is a common property of naturally evolved 
systems and is a desirable property in most man-made 
systems. There is now increasing evidence that the 



functioning of complex systems as diverse as cellular 
metabolism and power grids lies deep in the properties 
of underlying complex networks. This evidence has 
generated increasing interest on dynamical processes in 
complex networks and on how the interplay between 
these processes and network structure influences the 
performance and robustness of the system. Notably, 
established areas such as resource management, epidemic 
spreading, communication processes, synchronization 
dynamics, cellular biology, and cascading failures are 
at the leading edge of the current research on network 
optimization. We hope that this Focus Issue will provide 
the reader with an up to date overview of this exciting 
area of research. 
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